Listening. Learning. Leading: 



Building and Sharing Knowledge Key 
Practice: What Do You Know, What Don't 
You Know, What Did You Learn? 


Tenaha O'Reilly 
Paul Deane 
John Sabatini 












\©S 






V*>' 


& 








December 2015 








ETS Research Report Series 


EIGNOR EXECUTIVE EDITOR 

James Carlson 
Principal Psychometrician 

ASSOCIATE EDITORS 


Beata Beigman Klebanov 
Senior Research Scientist - NLP 

Heather Buzick 
Research Scientist 

Brent Bridgeman 

Distinguished Presidential Appointee 
Keelan Evanini 

Senior Research Scientist - NLP 

Marna Golub-Smith 
Principal Psychometrician 

Shelby Haberman 

Distinguished Presidential Appointee 


Donald Powers 

Managing Principal Research Scientist 

Gautam Puhan 
Principal Psychometrician 

John Sabatini 

Managing Principal Research Scientist 

Matthias von Davier 
Senior Research Director 

Rebecca Zwick 

Distinguished Presidential Appointee 


PRODUCTION EDITORS 


Kim Fryer Ayleen Stellhorn 

Manager, Editing Services Editor 


Since its 1947 founding, ETS has conducted and disseminated scientific research to support its products and services, and 
to advance the measurement and education fields. In keeping with these goals, ETS is committed to making its research 
freely available to the professional community and to the general public. Published accounts of ETS research, including 
papers in the ETS Research Report series, undergo a formal peer-review process by ETS staff to ensure that they meet 
established scientific and professional standards. All such ETS-conducted peer reviews are in addition to any reviews that 
outside organizations may provide as part of their own publication processes. Peer review notwithstanding, the positions 
expressed in the ETS Research Report series and other published accounts of ETS research are those of the authors and 
not necessarily those of the Officers and Trustees of Educational Testing Service. 

The Daniel Eignor Editorship is named in honor of Dr. Daniel R. Eignor, who from 2001 until 2011 served the Research and 
Development division as Editor for the ETS Research Report series. The Eignor Editorship has been created to recognize 
the pivotal leadership role that Dr. Eignor played in the research publication process at ETS. 




ETS Research Report Series ISSN 2330-8516 


RESEARCH REPORT 

Building and Sharing Knowledge Key Practice: What Do You 
Know, What Don't You Know, What Did You Learn? 

Tenaha O'Reilly, Paul Deane, & John Sabatini 

Educational Testing Service, Princeton, NJ 


In this paper we provide the rationale and foundation for the building and sharing knowledge key practice for the CBAL™ English 
language arts competency model. Building and sharing knowledge is a foundational literacy activity that enables students to learn and 
communicate what they read in texts. It is a strategic process that involves the integration of five key components or phases. Before 
reading, students activate their relevant background knowledge to help set learning goals, identify relevant information, and ask guiding 
questions that set the context for learning. During reading, students understand the text by using a host of strategies to construct a 
coherent mental model of the text content that is consistent with their background knowledge. Students clarify meanings of unknown 
words and concepts as they engage in metacognitive and self-regulated learning. After reading, students consolidate what they have read 
by using a variety of reading strategies that strengthen the representation in long-term memory. Finally, students convey what they have 
read in writing, speaking, or other representational formats to reflect communication goals and the intended audience. Collectively, 
the building and sharing knowledge key practice is intended to both model skilled performance and help identify component skill 
weakness. In this paper we outline the major features of the key practice as well as address potential advantages and challenges of the 
approach. 

Keywords CBAL™; key practice; scenario-based assessment 
doi: 10.1002/ets2.12074 


Reading and writing are complex skills that involve the coordination of a number of integrated components. Despite this 
complexity, educators are charged with the daunting responsibility of developing the literacy skills (reading and writ¬ 
ing) for learning, including those of students who may have fallen behind their grade-level peers. Educators need the 
right assessments for documenting growth and providing feedback that is meaningful and will move instruction forward. 
As part of the Educational Testing Service (ETS) research initiative called Cognitively Based Assessment of, for, and as 
Learning (CBAL™; Bennett & Gitomer, 2009), 1 an English language arts (ELA) project team is developing a set of 11 key 
practices that cover critical literacy activities required for college and career readiness. The key practices identify bundles 
of skills that students must integrate to achieve complex, capstone performances or outcomes. An analysis of key prac¬ 
tices identifies how skilled practitioners break the complex process down into major phases and links them to a set of 
component tasks and procedures that document where students are in their developmental trajectory. 

In this paper, we describe the rationale, empirical literature, and assessment opportunities for one such key practice: 
building and sharing knowledge. Building and sharing knowledge is foundational for a wide range of literacy activities. 
In learning from text, students need to know what they know, know what they do not know, and take strategic action to 
build up a coherent and complete understanding of text to increase their knowledge. This process is iterative. For example, 
students need to identify and correct any misconceptions or errors in understanding that may arise during their reading as 
new information and resources that reveal such errors become available. Readers also need to represent texts to themselves 
in ways that are deep, but succinct and organized, so that the memory representation formed is stable and enduring over 
time. Finally, students need to be able to communicate their understanding in ways that are appropriate for the goals of 
the communication and the intended audience. Although the process of building and sharing knowledge can be quite 
complex, it can be used to structure assessments that support skill development by helping to identify learning targets and 
by modeling and mirroring the key practice. 
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In the following section we provide the background and context for the building and sharing knowledge key practice, 
a construct definition, the rationale for why we need a building and sharing knowledge key practice, and an overview 
of the essential aspects of the practice as well as a review of the relevant empirical literature and an example assessment. 
In short, it is our hope that the building and sharing knowledge practice, and associated assessments, will help model 
effective learner habits by encouraging a strategic approach to literacy. 

Background and Context 

Criticisms of Traditional Assessments 

Reading comprehension assessment has a long and rich history (see Sarroub & Pearson, 1998) that has resulted in the 
development of a wide range of reliable and efficient measures. Despite this achievement, assessments are imperfect 
measures, and in recent years, reading comprehension assessments have been repeatedly criticized by researchers and 
educators. For example, existing reading comprehension assessments have been criticized as being atheoretical and not 
explicitly guided by the empirical literature (Hannon & Daneman, 2001); as relying too much on multiple-choice formats 
that target superficial understanding (Rupp, Feme, & Choi, 2006); as being thin on measuring key aspects of the con¬ 
struct at certain developmental levels (Paris & Hoffman, 2004); as being measures of students’ background knowledge 
rather than their reading ability (Katz & Lautenschlager, 2001); as being not very sensitive to the effects of reading inter¬ 
ventions (O’Reilly, Weeks, Sabatini, Halderman, & Steinberg, 2014); as being measures of only the product of reading and 
not the underlying process that feeds into it (Magliano, Millis, Ozuru, & McNamara, 2007); and as being a unique testing 
genre that requires learning-specific test-taking skills (Hornof, 2008). 

Time for Change? 

While many of these criticisms are not new (Sarroub & Pearson, 1998), recent advances in cognitive theory and technology 
(see Paris & Stahl, 2005; Sabatini, Albro, & O’Reilly, 2012; Sabatini, O’Reilly, & Albro, 2012) coupled with national large- 
scale efforts such as the Race to the Top funding (U.S. Department of Education, 2009), the Common Core State Standards 
(National Governors Association Center for Best Practices & Council of Chief State School Officers, 2010), and other 
seminal works (Partnership for 21st Century Skills, 2004, 2008; Pellegrino, Chudowsky, & Glaser, 2001) have opened the 
discussion and the door for a new generation of reading and writing assessments. In particular, this discussion has resulted 
in the recommendation to create assessments that are informed by the theoretical and empirical literature and provide 
instructionally useful information (Gordon Commission, 2013). 

CBAL 

In light of these and other forces, the researchers and assessment developers at ETS have embarked on a long-term research 
and development project to create a next generation of reading, writing, mathematics, and science assessments (Bennett, 
2010,2011; Bennett & Gitomer, 2009; ETS, 2014). This initiative, CBAL, has developed dozens of formative and summative 
assessments that have been administered to thousands of students across the country (Bennett, 2011). The items, tasks, 
assessments, and designs are based on detailed literature reviews conducted in each of the domains (see ETS, 2014, for links 
to the reviews). These literature reviews summarize the theoretical and empirical research in a wide variety of learning 
science areas including strategies, learning, memory, transfer, and best instructional practices specific to the domains of 
ELA (reading and writing), mathematics, and science. 

Relevant to the current paper, reviews and competency models have been developed for reading (O’Reilly & Sheehan, 
2009), writing (Deane et al., 2008), and recently, an integrated reading and writing ELA competency model (Deane, Saba¬ 
tini, & O’Reilly, 2012). As a general goal, CBAL assessments are designed to capture the complex performances required to 
succeed in 21st-century learning environments while simultaneously leveraging technology and cognitive science princi¬ 
ples to model and support learning for students across their developmental span. The details of the general CBAL initiative 
and the specific competency models are beyond the scope of the paper; interested readers are encouraged to visit the Web 
site (ETS, 2014) for more information. To set a context for our discussion of the building and sharing knowledge key 
practice, we provide a brief review of a critical CBAL design feature—the use of scenario-based assessment. 
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Scenario-Based Assessment 

Traditional reading assessments have no global purpose for reading other than to answer questions correctly (Rupp et al., 
2006). This lack of a global purpose for reading not only fails to reflect reading in the real world, but it also fails to 
provide a standard of coherence (Linderholm, Virtue, Tzeng, & van den Broek, 2004; van den Broek, Lorch, Linderholm, 
& Gustafson, 2001; van den Broek, Risden, & Husebye-Hartman, 1995) that students can use to evaluate the importance 
or relevance of the texts and sources (McCrudden, Magliano, & Schraw, 2011). Also, in traditional reading assessments, 
items are typically associated with a single passage, and there are no interconnections between items, tasks, and texts 
across the course of the assessment. 2 This design, while useful for measuring single-text comprehension, does not reflect 
the range of reading in 21st-century environments that demand multiple text comprehension (Britt & Rouet, 2012) and 
digital literacy (Coiro, 2009). 

Similarly, in many traditional writing assessments, students are given a generic prompt and are expected to write a 
coherent and informed essay without any source materials. Arguably, such tasks are artificial in the sense that they do 
not represent the types of writing required in college and careers for which we are trying to prepare students. In such 
contexts, students must typically read, summarize, analyze, critique, and integrate information across multiple sources as 
part of the writing process. Traditional writing assessments may, therefore, fall short, not only in measuring some of the 
most important skills of writing, but also in signaling what is important to learn and teach. To address the issues discussed 
above, the CBAL team has developed a technique called scenario-based assessment. 

A key innovation of CBAL designs is the use of scenario-based assessment to measure integrated reading and writing 
skills (Deane, 2011; Deane et al., 2012; O’Reilly & Sheehan, 2009; Sheehan & O’Reilly, 2012). Scenarios provide test takers 
with a realistic purpose for reading and writing about a collection of thematically related but diverse sources (O’Reilly 
& Sabatini, 2013; Sabatini, O’Reilly, & Deane, 2013). The sources help build students’ knowledge of the topic and also 
provide the material from which students can write thoughtful responses. Because the sources are thematic, the tasks 
have the potential to provoke deeper understanding. This deeper understanding is facilitated by requiring test takers to 
synthesize and integrate multiple sources and perspectives as well as evaluate their credibility. This deeper approach to 
measuring literacy is in contrast to many traditional assessments that have been criticized as measuring standards that are 
“a mile wide and an inch deep” (see Schmidt, McKnight, & Raizen, 1997, p. 122, for a discussion of narrowing standards). 

The potential advantage of the scenario-based design is that it contextualizes literacy activities by providing goals and 
a standard of coherence (Linderholm et al., 2004; van den Broek et al., 2001; van den Broek et al., 1995) for processing 
sources. The scenario and purpose for engaging in literacy activities help to define what is and what is not important to 
attend to and what constitutes quality performance. The contextualization, coupled with the sequencing and modeling of 
texts and tasks, allows test designers to ask deeper questions that demand more thoughtful written responses. This depth 
results because the assessment design digs into thematic issues rather than attempting to sample a wide, disparate range 
of general topics and standards at a shallow level (Schmidt et al., 1997). 3 

The Challenge for Scenario-Based Assessment 

The scenario-based approach, while innovative, also poses several challenges. For instance, too much contextualization 
may limit the generalizability of the assessment results — a criticism relevant to performance assessment more generally 
(Ryan, 2006). If the purposes for reading and writing are too narrow and the topical content too specialized, the skills 
measured may not transfer to other topics, texts, and tasks. On balance, we want to build assessments that not only are 
generalizable and practical, but also measure deep but broadly relevant reasoning and literacy skills. 

Key Practices 

The scenario-based approach, as operationalized in CBAL, aims to balance the competing goals of practicality and gath¬ 
ering evidence of deeper cognitive skills. It also has a parallel goal—helping to provide essential evidence about student 
learning that enhances educator understanding and capability to effect meaningful changes in practice. Toward this end 
of communicating assessment evidence to educators, we have developed the conceptual tool we are calling key practices. 
Key practices are sets of literacy activities that are meaningful to educators and can be applied to a wide range of liter¬ 
acy contexts. Key practices cover a constellation of skills that span a range from emergent literacy in young children to 
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Fundamental Literacy 




Application 



Figure 1 Key practices for the English language arts (ELA). 


proficiencies necessary for college and career readiness (and beyond). Key practices can be sensitive to a topic, but they 
are not necessarily limited by it. Rather, they represent a collection of processes, techniques, and strategies that are useful 
in modeling and measuring cross-cutting literacy activities. In other words, key practices help to translate scenarios into 
generalizable conceptual and instructionally relevant assessment designs. 

In accordance with these aims, we have developed 11 key practices that cover a wide range of meaningful reading and 
writing activities (see Figure 1; Deane et al., 2014). These key practices envelop a spectrum of literacy skills, from the 
foundational (e.g., communicate by speaking and listening) to the advanced levels that require students to go beyond the 
text and apply what they read (e.g., conduct inquiry and research). The key practices are organized along a quasidevelop- 
mental continuum. That continuum is based on the age or grade band at which instruction is most likely to emphasize a 
particular key practice. However, this clustering of key practices into levels should not be treated as a strict hierarchy. In 
fact, most of the key practices span the entire developmental continuum from preliterate speaking and listening activities 
through postsecondary proficiency. Nonetheless, it is helpful heuristically to consider when each key practice is likely to 
be a focal point of instruction. 

The first cluster of key practices is called fundamental literacy. The three fundamental literacy key practices composing 
the cluster serve as the foundation for speaking, listening, reading, writing, and thinking in ELA. This cluster includes 
such basic skills as word decoding, transcription, and basic print knowledge, which serve as the building blocks for basic 
understanding and communication. The second cluster, called model building, organizes the set of activities that are nec¬ 
essary for forming an understanding of text and communicating to an audience. These key practices include skills that 
enable students to form a representation of narrative and informational texts as well as fundamental practices authors 
use in conceptualizing, structuring, and organizing formal written communications. The third cluster, called application, 
involves the advanced set of skills that require students to go beyond the basic text representation and apply the meaning 
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for different purposes, such as to evaluate, integrate, solve problems, and communicate to particular audiences. While 
the details of each of the 11 key practices are beyond the scope of the current paper, interested readers are encouraged to 
consult Deane et al. (2014) for more information. The purpose of the current paper is to provide a detailed description of 
the model-building key practice, building and sharing knowledge. 

Definition 

Building and sharing knowledge refers to the constellation of knowledge, skills, and abilities that are required to under¬ 
stand, learn from texts, and communicate or represent that understanding to an audience. It includes the set of strategic 
abilities, metacognitive activities, and self-regulatory actions students engage in before, during, and after reading. Before 
reading, students consider their reading or learning goals and activate relevant background knowledge by previewing key 
sections of the text and generating guiding questions. This constellation of skills also includes the set of skills for judg¬ 
ing the relevance and usefulness of information for particular literacy goals. During reading, students construct a mental 
model of the text to help them understand the text at deeper levels. Students take action to clarify meanings and gaps in 
understanding to ensure the mental model is internally coherent from the word to the discourse level of understanding. 
Students consolidate their understanding by organizing, summarizing, and elaborating what they have learned. In some 
cases, students may test the limits of their understanding by consulting multiple sources and by applying what they read 
to new situations and contexts. Finally, students convey what they have learned to targeted audiences and adjust their 
communication accordingly (see Figure 2). 

From this definition, we can extract some general themes. First, the skills that feed into building and sharing knowledge 
are intertwined and complex. The multifaceted skills forming a collection work in tandem, and no one skill is sufficient for 


What are my goals in reading this text(s)? What is 
the author’s purpose in writing the text? What will 
the text talk about? How much do I already know? 
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Figure 2 Activity diagram for building and sharing knowledge. 
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proficient performance. Second, building and sharing knowledge is a process. Not every step in the process is necessary 
for every literacy task; however, structuring the key practice into manageable steps is likely to model good habits of mind 
and possibly provide more information on what parts of the larger task students can or cannot do. Third, building and 
sharing knowledge is an iterative process. Understanding is dynamic, and it often requires revisiting the text and one’s 
own understanding to clarify or check the veracity of claims or the global coherence of the intended message. Fourth, 
building and sharing knowledge is strategic. Students can use a wide range of literacy strategies to reduce processing load 
(e.g., reduce the working memory demands) or to improve the long-term retention of the meaning of the text. Below, we 
explain some of the rationale for why a building and sharing knowledge key practice is necessary. 

Why Building and Sharing Knowledge Is Educationally Important 
Text Processing Demands 

Texts are complex and incomplete and thus require strategic processing. As mentioned above, reading comprehension 
is a complex process (McNamara & Magliano, 2009; Perfetti & Adlof, 2012). Part of this complexity resides in the 
set of integrated skills necessary to understand text; other challenges are raised by the nature of the texts themselves 
(Snow, 2002). For example, textbooks are often inconsiderate for readers — they frequently comprise complex, long, and 
sometimes incomplete blocks (Beck, McKeown, & Gromoll, 1989; Chi, de Leeuw, Chiu, & LaVancher, 1994; Konopak, 
1988; McNamara & Kintsch, 1996; McNamara, Kintsch, Songer, & Kintsch, 1996; Wilson & Anderson, 1986). Conse¬ 
quently, to deeply understand text requires the reader to engage a variety of strategic processes that make the text more 
manageable and coherent (McNamara, 2007). In other words, deriving meaning from text is an active and effortful 
process. 

For instance, to deal with longer texts, students need to extract the key ideas in order to reduce memory load (Franzke, 
Kintsch, Caccamise, Johnson, & Dooley, 2005). This activity requires leaving out many minor details or irrelevant events. 
Conversely, sometimes authors leave out key background information because they assume readers already know it; this 
omission can result in texts that are perceived as disconnected by low-knowledge readers (Beck et al., 1989). When such 
gaps are present in texts, readers need to draw knowledge-based inferences to fill in the unstated information (McNamara, 
de Vega, & O’Reilly, 2007). The consequence of this text processing is the formation of a mental representation, sometimes 
called a mental model of the text (Centner & Stevens, 1983; Johns on-Laird, 1983; van Dijk & Kintsch, 1983), as described 
in the next section. 

The Need for Mental Models 

Readers need to construct mental models. The concept of a mental model is present in most theories of reading, includ¬ 
ing the construction integration model (Kintsch, 1998, 2004, 2012; van Dijk & Kintsch, 1983); the constructionist the¬ 
ory (Graesser, Singer, & Trabasso, 1994); the structure building framework (Gernsbacher, 1990, 1997); the landscape 
model (van den Broek et ah, 2001; van den Broek et ah, 1995; van den Broek, Young, Tzeng, & Linderholm, 1999); the 
event indexing model (Zwaan, Langston, & Graesser 1995; Zwaan & Radvansky, 1998); the resonance model (Myers & 
O’Brien, 1998); and the minimalist hypothesis (McKoon & Ratcliff, 1992). See McNamara & Magliano (2009) for a general 
review. 

Although different theories posit different ways of describing a mental model and how it is formed, there are some 
common features. First, mental models are representations of the text. As such, they rarely involve verbatim memorization, 
though there may be some particular clauses or quotes that are retained. In lay terms, much of the representation is 
constructed in the students own words. Thus, the formation of a mental model involves recoding of the text for long-term 
storage (e.g., Kintsch, 1998, describes the memory units as propositions). Second, sound mental models are reductionistic 
in nature—key ideas, concepts, and principles are retained, but many minor details are often left out (Franzke et ah, 2005). 
In other words, mental models are often strategic simplifications of the full text. Third, sound mental models are organized 
to reflect the basic structure of the text (Meyer & Ray, 2011). While certain details in the mental model might be left out, 
how the main points are structured, sequenced, and described should be preserved as a part of the mental model (e.g., 
problem-solution, compare-contrast). Fourth, sound mental models are internally coherent and gaps in understanding 
need to be filled in with knowledge-based inferences (McNamara et ah, 2007). When texts are incomplete, students need 
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to make connections so that the main ideas and causal structure line up. As such, students need to self-regulate their 
learning and be metacognitively aware of their understanding. 

The Need for Self-Regulation 

Readers need to self-regulate their understanding as they read. Although the formation of an initial mental model is 
important, we argue that it is not enough. Students need to be able to monitor and check the accuracy of the model and 
repair it when necessary (Hacker, Dunlosky, & Graesser, 2009). They need to update the model when new information is 
present and check it against background and general world knowledge (Kintsch, 1998, 2004, 2012). Students also need to 
test the limits of their understanding by applying what they know to new contexts and situations (O’Reilly & Sabatini, 2013; 
O’Reilly & Sheehan, 2009; Sabatini, O’Reilly, & Deane, 2013). Understanding also needs to be communicated. Students 
need to be able to share what they know and communicate it effectively to particular audiences. This activity involves an 
understanding of audience so that the presentation or written communication can be tailored (Bereiter & Scardamalia, 
1987; Midgette, Haria, & MacArthur, 2008). Collectively, this strategic process requires the self-regulatory skills to keep 
learning on track. 

In summary, the formation of a mental model is effortful, strategic, and complex, and many students may have difficulty 
either with component processes or in coordinating these skills to support effective learning from (and communication 
about) informational text. Building assessment scenarios that model this process is likely to benefit a range of students 
for several reasons. First, by deconstructing and modeling the process that makes up the building and sharing knowledge 
bundle, the tacit components become more explicit. The integrated nature of complex performances, such as the con¬ 
struction and sharing of a mental model, is often opaque for less skilled readers. Having a step-by-step breakdown of the 
process in the form of an assessment may serve as a recipe that is more tractable and easier to follow than simply viewing 
the final product itself. 

Second, having a tractable set of tasks that measures the various components of the key practice may help signal weak¬ 
nesses in component processes or phases. In turn, these signals may act as starting points for further instruction. Third, 
the process of building and sharing knowledge cuts across a range of text genres and is foundational to a host of other more 
complex applied key practices. In order for more complex skills, such as critical thinking, to operate, a strong foundation 
of what the text says is important. Collectively, the building and sharing knowledge key practice is generalizable across a 
range of literacy activities, and it is foundational for higher level key practices. Assessments that measure and model this 
practice are likely to have a wide range of trickledown benefits. In the next section, we provide an overview of the five 
key elements that comprise the building and sharing knowledge bundle and review some of the relevant literature that 
informed its development. 


Overview of Building and Sharing Knowledge 

The building and sharing knowledge key practice was derived from the more general CBAL ELA framework, as expressed 
in the CBAL wiki (http://elalp.cbalwiki.ets.org/) and related publications (Deane, 2011). The framework focuses on defin¬ 
ing categories of activities and skills and mapping these categories onto learning progressions, which are then used to 
define measurement targets for specific tasks. Learning progressions are hypothesized developmental sequences that lay 
out the qualitative levels through which students might pass as they progress toward skill proficiency. In other words, 
integrating the learning progressions into an assessment design allows assessment designers to break down more complex 
performances into smaller units so that the current sophistication level of the student is more visible and the instructional 
decisions are potentially more targeted. 

The current paper reflects the accumulation of prior work that focused on developing learning progressions relevant 
to the building and sharing knowledge key practice (see the Appendix for examples in Tables A1 to A14). However, the 
purpose of this document is not to delve into the details of individual learning progressions but to provide an overview 
of the core features of the key practice as a whole. With this goal in mind, Figure 2 shows the general structure of the 
building and sharing knowledge key practice, which relates the information provided in texts to the knowledge activated 
or acquired by an individual during reading. This activity diagram corresponds to the kind of reading most often per¬ 
formed with purely informational texts. It is based in part upon analyses of reading and writing strategies and practices 
to be found in prior CBAL literature reviews (Deane, 2011; Deane et al., 2008; O’Reilly & Sheehan, 2009). It is intended 
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to capture key activities in which people may engage if their purpose is to build and share knowledge from a textual 
source. 

According to this analysis, five major types of activities are involved in this activity system: 

• Set goals and activate prior knowledge. Reading is a purposeful activity. This purpose may simply be to learn about a 
new topic, or it may be more targeted. Considering one’s general goals will help to set a standard of coherence and of 
the relative importance of different pieces of information in a text. With some general or specific purpose in mind, 
the reader then would engage a class of activities corresponding to prereading strategies, though brainstorming 
strategies, for example, in preparation for writing an informational text, may also be called upon. With a clear goal 
or purpose in mind, students are also in a better position to write a more effective communication that is targeted to 
a particular audience. Especially relevant strategies are those that support goal setting and the retrieval of relevant 
knowledge from long-term memory to support reading or producing an informational text. 

• Understand the text. This class of activities corresponds to normal reading for comprehension, where the focus is 
on building a sound, coherent representation of text content (i.e., a sound mental model that is concise, accurate, 
and coherent). Building understanding of a grade-level text typically presupposes mastery of an earlier, emergent- 
reading key practice (reading silently and aloud) at a level commensurate with grade-level text linguistic structures, 
which is why we have represented that practice using a shadowed figure placed mostly behind the figure labeled 
“Understand the Text.” 

• Clarify meanings. This class of activities corresponds to a range of comprehension repair and learning activities 
designed to build a richer, more accurate representation of text meaning, even in the face of comprehension failures. 
Clarifying meaning specifically presupposes sufficient mastery of an earlier language-skills key practice (use and 
understand language) to have high levels of metalinguistic awareness as a tool to support comprehension repair, 
which is why we have represented that practice using a shadowed figure placed mostly behind the figure labeled 
“Clarify Meanings.” 

• Consolidate knowledge. This class of activities corresponds to a range of reading strategies designed to consolidate 
textual content with prior knowledge for deeper and more stable representation. The key practice overlaps with 
skills deployed in other key practices we have identified, most notably, research and inquiry. 

• Convey knowledge. This class of activities comprises a range of writing or representation skills needed to organize 
and present information to a particular audience. Conveying knowledge specifically presupposes sufficient mastery 
of the emergent-writing key practice (write down words and ideas) at the grade level of text sophistication to support 
the goal of conveying knowledge. For this reason, we have represented that earlier practice using a shadowed figure 
placed mostly behind the figure labeled “Convey Knowledge.” 

In Figure 2, each of the five activity types is paired with a set of questions designed to identify the goals and subgoals 
that individuals might progress through as they build their understanding. 

Note that we arranged the activities in a circle, with an implied (but not strictly necessary) clockwise flow from goal 
setting and activating knowledge to understanding the text, clarifying meanings, consolidating knowledge, and convey¬ 
ing knowledge. We do not intend to communicate a strict order, since a nonlinear or multilayered integrated approach to 
reading is consistent with expert practice. There maybe multiple passes over the text, with multiple episodes of each activ¬ 
ity type, and the order may proceed in any combination from moment to moment. A two-step counterclockwise sequence, 
for example, from activating knowledge to conveying knowledge, represents a simple knowledge-telling approach to writ¬ 
ing an informational text. Skilled writing, however, will include rereading one’s own text (applying the other activity types 
to assess how well one’s own text supports reading), which entails more incremental, recursive processing. The activity 
diagram is intended to capture common sequences that may be helpful didactically. The diagram might be helpful when 
introducing the concepts to students, as well as in specifying major classes of activities that are important for a particular 
phase. However the diagram is not intended to provide a strict, uniform directional process model. 

From the individual activities, or phases in the practice, we can identify the skills needed to support that activity, and 
from the skills, we can map to learning progressions. For building and sharing knowledge, some of those skills fall into 
the conceptual category of the larger CBAF classification of learning progressions, some fall into the discourse category, 
and some are in the verbal category. These skills are labeled as appropriate (see Table 1). In Table 1, the rows correspond 
to classes of activities from Figure 2; the columns refer to specific task types that can be used to accomplish that activity’s 
goals. The individual skills represent specific activities (which may in turn require specific knowledge, skills, and abilities) 
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Table 1 Mapping From the Activity Diagram to Specific Targeted Skills 


Goal Setting and Activating Prior Knowledge a 

Genre Differentiation Print Cue Sensitivity 


Determine what sort of text 
one is dealing with, infer 
readers’ or authors 
purposes, and set 
expectations and goals for 
reading. 


Identify structural features of 
the text and use these to 
identify/recall key terms 
and concepts. 


Verbal & Conceptual 
Association 
Scan for repeated or 
associated words that 
identify key topics and 
themes, [was part of 
vocabulary development] 


Kn owledge- Telling 

Review what one already knows 
about the topic(s) addressed 
by the text, possibly writing 
them out in some form to 
solidify them in memory and 
provide an external cue for 
further reasoning or analysis, 
[was self-explanation] 


Understanding the Text (may also be 

Discourse Fluency & Control 

Maintain sufficient fluency, 
control, and coordination of 
text production and 
comprehension to support 
efficient processing of the text. 

Clarifying Meanings 

Word Formation 

Use morphological relationships 
between words to infer the 
meaning and use of unfamiliar 
vocabulary, [was analogy] 


Sentence Context 
Use sentence context to infer 
what a word or phrase must 
mean in context. 


to support consolidation of knowledge) 

Outlining 

Explicitly represent the 

hierarchical structure of a text, 
possibly using some form of 
graphic organizer or other 
external representation of text 
content. 

Definition and Lookup 

Clarify what a word or concept 
means using the reasoning 
strategies built into formal 
definition; clarify 
understanding of a text using 
lexical tools such as a 
dictionary. 

Paraphrase 

Capture a clear understanding of 
what part of a text means by 
recasting the same meaning in 
different words. 


Knowledge-Based Inference 
Bridge gaps and specify details by 
making inferences that draw 
upon prior knowledge of the 
topic, [was prediction] 


Multiple Meanings 
Recognize when a word or 
sentence structure has 
multiple possible meanings; 
infer new word meanings 
using metaphor, metonymy, 
and other conceptual 
relationships. 

Logical Analysis 
Clarify the meaning and 
implications of a statement 
using sentence form to 
constrain logical reasoning. 
[On wiki: Verbal Inference] 


used 


Consolidating Knowledge (also support understanding the text) 

Summary/Main Ideas Compare, Contrast, and Organize 

Form a gist understanding of the text that captures main Compare and contrast the discourse structure and content 

and supporting ideas; use this gist representation to recall of multiple sources on a topic; organize information with 

information for further use. respect to salient categories or goal-driven purposes. 


(P)Review: Apply Standards for Quality of Informational Text [on wiki] 


Conveying Knowledge 

Framing an Exposition 
Arrange content for 
communication to 
others. 


Relevance 

Discipline oneself to 
expressing only 
information relevant to 
the topic, purpose, and 
specific ideas in focus. 


Accuracy 

Discipline what is said 
or written to avoid 
conveying incorrect 
information. 


Level of Detail 
Discipline the level of 
detail so as to 
provide useful 
information without 
belaboring the 
obvious. 


Clarity of Expression 
Choose language that 
expresses the 
information to be 
conveyed clearly but 
concisely. 


a This row needs to be expanded somewhat to include goal-setting skills, which we will address in future work. 
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that fit into the larger frame provided by Figure 2, but activities in the same row work together to achieve the same 
subgoals. Each cell in Table 1 corresponds to a hypothesized learning progression. The links in the table connect either to 
the Appendix or to the CBAL wiki, cited earlier. Some of the progressions presented in Table 1 are new or revised from 
the version on the CBAL wiki. In the discussion that follows, we briefly review some of the relevant strategy and learning 
science literature that led to the development of the five phases in the building and sharing knowledge bundle. 

Relevant Literature 

Set Goals and Activate Background Knowledge 

Knowing what one knows and does not know can help an individual assimilate new information as well as identify goals 
or learning intentions (P. A. Alexander, Murphy, & Kulikowich, 2009) for what to find out while reading. Moreover, having 
a specific purpose for reading can also serve as a criterion for determining whether the text is relevant for that purpose 
(McCrudden et al., 2011). These strategic prereading behaviors are foundational for later phases in the key practice. In the 
building and sharing knowledge key practice, activating relevant knowledge is also critical. Relevant knowledge of the text 
structure (Meyer & Wijekumar, 2007), the topic, content or discipline (S. Goldman, 2012), the author, and the author’s 
purpose (P. Alexander, 2012; Meyer, 1987) will all likely provide an advantage to students before they read the text. 

Why do these prereading and activating-knowledge behaviors help? Research has shown a relationship among reading, 
writing, and the level of students’ background knowledge (Benton, Corkill, Sharp, Downey, & Khramtsova, 1995; Cromley 
& Azevedo, 2007; S. J. Davis & Winek, 1989; DeGroff, 1987; Shapiro, 2004). In general, this literature indicates that students 
who know more about a topic generally comprehend and write more effective essays than students with lower levels of 
background knowledge. Background knowledge may help students comprehend and write more effectively in several 
ways. First, background knowledge serves as a structure or schema (Mandler, 1984) for integrating and organizing new 
knowledge (Kintsch, 1998,2004,2012). It is much easier to slot new information into a known structure than to build a new 
structure from scratch. Second, background knowledge provides readers with the inferences needed to fill in conceptual 
gaps encountered in text (McNamara & Kintsch, 1996). That is, background knowledge provides readers with both a 
structure and a mechanism for assimilating and modifying new information. 

When building new knowledge during reading, it is often advantageous to activate existing knowledge relevant to the 
topic of the text. This activation is advantageous because the brain is a network of associations, and activation spreads 
to related concepts (Anderson, 1983). In other words, thinking about a topic such as organic farming is likely to trigger 
other related concepts such as natural ingredients and healthy food. This spread of activation allows individuals to recall 
concepts related to the topic in question. In effect this is like a warm up activity before reading. With these related concepts 
at hand, students have a structure to integrate new information as they read (e.g., green living). 

In the reading strategy literature, the activation of relevant knowledge is a key element in the previewing strategy 
(Spires, Gallini, & Riggsbee, 1992). 4 During the previewing strategy, students skim key aspects of the text to activate 
relevant background knowledge and to generate a list of questions to guide further reading. These text aspects include the 
title, headings, bold and italicized words, and chapter questions. Previewing these key sections of the text is likely to help 
the reader get a better sense of what the text will describe (i.e., set expectations) and also to help draw the reader’s attention 
to areas that might be problematic (e.g., difficult vocabulary, unfamiliar concepts). For the previewed areas of the text that 
are problematic, the readers can generate questions that can be used as guides when reading the text in full. Answering 
these guiding questions while reading should result in a more complete understanding of the text than if gaps are left 
unchecked. This metacognitive and self-regulatory function of the previewing strategy is a critical part of the building 
and sharing knowledge key practice and is described in a later section. 

More broadly however, the previewing strategy has been shown to improve reading comprehension (Spires et al., 1992). 
Thus, integrating some previewing strategy and the more general approach of activating background knowledge in a 
reading assessment might improve performance and model good reading practices. In short, setting goals and activating 
relevant background knowledge is a useful prereading strategy and a foundational step in building and sharing knowledge. 

Understand the Text 

The aim of the goal-setting and background-knowledge-activating parts of the building and sharing knowledge key prac¬ 
tice is to better prepare the student before reading the full text. In contrast, the purpose of the understand text phase 
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is for readers to build a sound mental model (i.e., concise, accurate, and coherent) while they are reading. On the sur¬ 
face, the understand the text phase might seem relatively simple: Students just need to decode the words and then the 
meaning becomes self-evident. However, what it means to understand and the process of reaching an acceptable level 
of understanding are often complicated (McNamara & Magliano, 2009). As described earlier, students need to construct 
a mental model of the text (Kintsch, 1998, 2012); this process involves many steps, and it can go awry at many points. 
Critical information needs to be identified, irrelevant details need to be suppressed, relations among key ideas need to be 
preserved, gaps must be filled in, an organizational structure needs to be created, and coherence should be maintained at 
all levels (Franzke et al., 2005; S. Goldman & Rakestraw, 2000; Graesser et al., 1994; McNamara et al., 2007; McNamara & 
Magliano, 2009; Meyer & Ray, 2011; Perfetti & Adlof, 2012; van den Broeket al., 1995; Zwaan et al., 1995). 

Although constructing a concise, accurate, and coherent representation may be relatively easy for skilled readers, it 
may be difficult for less skilled readers. For this reason, CBAL designs are geared toward modeling good habits of mind 
and adding supports for this latter group (i.e., the assessment can be a learning experience in and of itself). From a design 
perspective, this modeling and support can be achieved in a number of ways, most notably by incorporating a variety of 
reading strategies in the assessment design (McNamara, 2007). Reading strategies are sets of actions that modify, elaborate, 
simplify, organize, or re-represent textual information for the purposes of improving reading comprehension. 5 

Reading strategies include, but are not limited to, visualization/imagery (Oakhill & Patel, 1991), paraphrasing (Fisk & 
Hurst, 2003; Hagaman, Casey, & Reid, 2012; Hua, Woods-Groves, Ford, & Nobles, 2014), elaborating (Menke & Pressley, 
1994), predicting (Afflerbach, 1990), self-explanation (McNamara, 2004), note taking (Faber, Morris, & Lieberman, 2000), 
summarization (Franzke et al., 2005), previewing (Faber et al., 2000; Spires, 1993), inferring the meaning of unknown 
words from context (McKeown, Crosson, Artz, Sandora, & Beck, 2013), and using graphic organizers and text structure 
(S. Goldman & Rakestraw, 2000; Meyer & Wijekumar, 2007). Collectively, these strategies have been effective in improving 
reading comprehension. They can be incorporated into assessments as evidence-eliciting tasks as well as improve the 
instructional relevance of the assessment (O’Reilly & Sabatini, 2013). 

In relation to the understand the text phase of the building and sharing knowledge key practice, a variety of strategies 
are likely to be useful including paraphrasing, note taking, and inferring word meanings from context and imagery. For 
instance, paraphrasing allows students to put the text into their own words and can increase memory for and compre¬ 
hension of text. Note taking can help identify key ideas and elicit questions the student can use to guide further reading. 
Students can also use the contextual cues to help them infer the meanings of unknown words. Additionally, visualization 
and imagery strategies can create alternate representations for strengthening the meaning of text (e.g., dual code theory, 
Pavio, 1986). Collectively, these and other reading strategies can serve as a basis for building meaning of the text at the 
word, sentence, and discourse levels. In effect, reading strategies help facilitate the construction of sound and stable mental 
models of text (McNamara, 2007). 

The process of understanding the text, however, presupposes mastery of the emergent reading key practice, reading 
silently and aloud, at a level commensurate with grade-appropriate text linguistic structures. For that reason, we have rep¬ 
resented that practice using a shadowed figure placed mostly behind the figure labeled “Understand the Text” in Figure 2. 
Finally, although much attention in the classroom has been focused on teaching reading skills and strategies, much less 
attention has been given to other important reading influences such as metacognition and self-regulation (Afflerbach, 
Cho, Kim, Carassas, & Doyle, 2013), which is taken up in the next section. 

Clarify Meanings 

The first two aspects of the building and sharing knowledge key practice are designed to activate relevant background 
knowledge and to build an initial model of the text. Although this aspect of the key practice might sound linear in theory, 
in reality, knowledge building is an iterative process. Initial concepts, ideas, and relations are constructed over cycles and 
updated when new information is revealed in the passage (see the landscape theory, van den Broek et al., 1999). Students 
revisit and revise initial interpretations based on accumulating evidence. This process is complex and requires the students 
to be metacognitively aware of their understanding and to deploy a range of self-regulatory behaviors to ensure that gaps 
in understanding and errors in reasoning are rectified. 

In general, this class of activities corresponds to a range of comprehension repair and learning processes designed 
to build a richer, more accurate representation of text meaning, even in the face of comprehension failures. Clar¬ 
ifying meaning specifically presupposes sufficient mastery of the language-skills key practice, use and understand 
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language, to have high levels of metalinguistic awareness as a tool to support comprehension repair. As a conse¬ 
quence, we have represented that practice using a shadowed Figure 2 placed mostly behind the figure labeled “Clarify 
Meanings.” 

The clarify meanings phase of the building and sharing knowledge key practice is consistent with the literature on 
metacognition and self-regulation. 6 Although precise definitions of the term metacognition tend to vary, researchers 
generally agree that metacognition is the state of being aware of one’s understanding (Hacker et al., 2009) and is 
often described as involving a set of processes including planning, monitoring, and evaluating (Schraw, 1998). Whereas 
metacognition is more reflective, self-regulation is more behavior directed (P. Alexander, 2012); in reading, self-regulation 
involves the set of actions to correct misconceptions or repair gaps in understanding. 

Although a relationship exists between skilled reading and metacognition (Oakhill, Hartt, & Samols, 2005) and 
metacognition and learning (Thiede, Anderson, & Therriault, 2003), research has shown that many students are not 
very accurate at judging their own learning. According to one review of the literature, students’ judgments of learning 
are accurate less than 30% of the time (Maki, 1998). More recent reviews confirm the relative inaccurate nature of 
self-judgments of learning (Dunlosky & Lipko, 2007). Such low levels of monitoring accuracy have led some researchers 
to theorize about the causes of students’ poor judgments. One view holds that student monitoring ability is often poor 
because students have not learned information at a deep level (see Dunlosky & Lipko, 2007). In support of this view, 
metacomprehension accuracy increases when students read texts in ways that force deeper processing. For example, 
summarizing text (Thiede & Anderson 2003), rereading text (Rawson, Dunlosky, & Thiede, 2000), and generating key 
words (Thiede, Dunlosky, Griffin, & Wiley, 2005) before making judgments of learning have all been found to improve 
metacomprehension accuracy. Presumably, metacognitive ability improves learning by providing students with the 
wherewithal to notice when comprehension breaks down and also the ability to repair it. 

In terms of the building and sharing knowledge practice, students need to ask whether they are understanding the 
passage, whether the information presented in the text is consistent, and whether there are any outstanding gaps. If there 
are comprehension problems, students need to repair them by using strategies such as those mentioned in the previous 
section. Additionally, some of the other strategies listed in Table 1 also might be especially useful when the source of 
comprehension difficulty stems from not understanding specific words or phrases, including word formation, definition 
and lookup, multiple meanings, sentence context, and logical analysis. Collectively, strategies, metacognitive awareness, 
and self-regulation help to keep learning on track. The iterative nature of these processes can necessitate their need at any 
stage of reading: before, during, or after reading the text. 

Consolidate Knowledge 

The clarify meanings aspect is designed to increase student awareness of their understanding and to take action to repair 
any problems that detract from the global coherence of their mental model of text. While these metacognitive and self- 
regulatory behaviors are critical in building a coherent mental model, they are not enough. Coherent mental models also 
need to be deep and long-lasting. Students need to build rich representations that endure over time and are flexible over 
a wider range of situations (Healy et al., 1993). In short, students need to consolidate what they have read and learned. 

To achieve these aims, the consolidate knowledge phase of the key practice includes several design features. First, 
rich situation models require that students integrate their background knowledge with the text (Kintsch, 1998, 2012). 
In an assessment or learning context, this integration can be facilitated by conjoining the goal setting and activating 
knowledge phase discussed earlier with the consolidate phase discussed here. When activating knowledge, students are 
encouraged to retrieve knowledge that is relevant to the text; however, since students have not read the text at this point, 
they cannot integrate it with what they already know. The consolidation phase makes the integration between the text and 
prior knowledge possible. 

This solidifying process of integrating knowledge with the text is at the heart of the reading strategy called the 
Know-Want-Learn (KWL) technique (Cantrell, Fusaro, & Dougherty, 2000; Lewis, Wray, & Rospigliosi, 1994; Ogle, 
1986). During the KWL strategy, 7 students preview key sections of the text, generate questions they have about confusing 
parts, read the text, answer the questions, and finally report what they have learned and how it connects to what they 
know. The last two steps, tying up loose ends by answering outstanding questions and explicitly indicating what they 
learned in relation to what they know, are essential steps in the consolidate phase. Focusing on what one has learned 
necessarily entails the integration of what one knew before reading with what one gained afterward. Concentrating 
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effort on the learning of new information underscores the importance of the text in making a lasting impression on the 
student. 

Knowledge integration is a key part of the consolidate process; however, there are other ways to improve the stability 
of the mental representation of what was read. A second technique is to draw upon other reading strategies to ensure 
that what was read sticks with the reader over time (McNamara, 2007). These strategies include relatively simple tech¬ 
niques such as rereading (Cioffi, 1986; Millis & King, 2001) and testing oneself on the content of what was read (i.e., 
the testing effect; see McDaniel, Anderson, Derbish, & Morrisette, 2007); more global strategies such as summarization 
(Franzke et al., 2005; Ihiede & Anderson, 2003) and the creation of graphic organizers that capitalize on text structure 
(S. Goldman & Rakestraw, 2000; Meyer & Ray, 2011; Meyer & Wijekumar, 2007); and more demanding strategies such 
as self-explanation (Chi et al., 1994; McNamara, 2004; McNamara, O’Reilly, Best, & Ozuru, 2006). Rereading and self¬ 
testing are designed to strengthen the memory for text by reactivating the information and ensuring that it is learned. 
Summarization and the creation of graphic organizers are designed to simplify the text into its key elements so that it is 
more manageable and thus more memorable and stable. Self-explanation is designed to deepen the mental representation 
by using strategies from elaboration, making bridging inferences, or making the causal relations in text more prominent. 

In addition to increasing the stability of the memory representation of what was read, skilled readers deploy other 
techniques to ensure the flexibility of the mental models they form. Toward this end, a third recommendation is that a 
reader reviews the concepts, principles, and issues discussed in text from multiple perspectives, points of view, or sources. 
This review can, in part, be achieved by requiring the student to read multiple texts on the topic in question (S. Goldman, 
Lawless, Pellegrino, Braasch, & Gomez, 2011; S. Goldman, 2012; S. R. Goldman, 2004; McCrudden et al., 2011; Rouet & 
Britt, 2011; Stromso, Braten, & Britt, 2010). Multiple texts contain information on similar topics but are often written by 
different authors, represent different perspectives, and may represent different genres. This variety can help expand the 
context of learning and the readers’ scope in understanding. The use of multiple texts is at the heart of the research and 
inquiry key practice, so we include it here as a possible way to enhance the flexibility or robustness of students’ mental 
models. 

Fourth, richer models of text understanding are facilitated when students apply and attempt to transfer what they have 
learned to new situations (O’Reilly & Sheehan, 2009; Sabatini et al., 2013). If students are to read and learn at deeper levels, 
they should be able to do more than recall or recite what they have learned. Students should also be able to extract themes, 
principles, and concepts and then organize that knowledge to form deeper, more stable, and more flexible representations 
that they can then flexibly apply to new situations and source materials. 

To summarize, skilled readers deploy a range of postreading strategies designed to consolidate their understanding. 
Students need to consider what they have learned from the text and integrate it with their existing background knowledge. 
New information can be added to existing background knowledge, or in some cases, it may modify it. However, the aim 
of the consolidate phase is not limited to knowledge integration. Students need to use a variety of strategies to strengthen 
their understanding to ensure that their mental model is rich and lasting. This effect can be achieved by requiring students 
to elaborate, self-explain, reread, or test themselves on the content. The flexibly of their representations can be facilitated 
by broadening the context for learning (e.g., requiring students to integrate multiple texts) and by requiring students to 
apply what they know to new situations (i.e., transfer). As discussed below, the process of conveying what was learned 
may also facilitate consolidation. 

Convey Knowledge 

The prior four elements in the building and sharing knowledge key practice are designed to develop deep, accurate, coher¬ 
ent, integrated, flexible, and lasting mental models of the text. However, reading and writing skills are social activities 
(Deane et al., 2008; Deane et al., 2012; Gorin, O’Reilly, Sabatini, Song, & Deane, 2014; Sabatini et al., 2013; Snow, 2002), 
and at a high level, a common goal of literacy activities is to communicate a message to an intended audience. In light of 
efforts to promote 21st-century skills (Partnership for 21st Century Skills, 2004, 2008) and college and career readiness 
(National Governors Association Center for Best Practices & Council of Chief State School Officers, 2010), the commu¬ 
nicative and social element of literacy has gained new ground. 

In the CBAL ELA model, proficient students should not only be able to read and understand texts, but they should 
also be able to communicate, through writing or speaking, what they have read and learned (Deane et al., 2008; Deane 
et al., 2012). Appropriate communication is bound by the purpose of the communication and the intended audience. The 
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message may need to be carefully tailored to include the appropriate focus, amount of detail, and use of language and 
rhetoric that will engage and inform that audience. 

According to Grice (1975), people generally follow a set of basic rules when communicating. For instance, the coop¬ 
erative principle states that people should: “Make your contribution such as it is required, at the stage at which it occurs, 
by the accepted purpose or direction of the talk exchange in which you are engaged” (Grice, 1975, p. 45). 

When people communicate, unwritten rules ensure that communication flows and people understand what is said. This 
cooperative idea is further elaborated in the now famous four Grecian maxims: quality, quantity, relation, and manner. 
The quality maxim states that people should only state true information and not say anything without evidence to back it 
up. The principle of quantity states that people should say enough so that the message is fully understood but not too much 
to avoid over-complicating the issue. The relevance maxim states that communications should present only information 
that is relevant to the topic, and unnecessary tangents should be avoided. The maxim of manner basically states that 
communications should be structured, concise, and avoid ambiguity and unnecessarily difficult and obscure language. 
While the Grecian maxims and Grice’s (1975) general philosophy have been criticized (see W. Davis, 1998), they are a 
useful heuristic to consider when communicating (Saul, 2001), as well as a source for criteria to use in assessments that 
measure communication skill. 

More concretely, the class of activities used to convey knowledge comprises a range of writing skills needed to orga¬ 
nize and present information to an audience. Conveying knowledge specifically presupposes sufficient mastery of the 
emergent-writing key practice, write down words and ideas, to effectively support students as they seek to convey knowl¬ 
edge that they have gained through informational reading. That earlier practice is represented using a shadowed figure 
placed mostly in the background of the part of Figure 2 labeled “Convey Knowledge.” 

Altogether, proficiency in modern literacy contexts requires that students can communicate their deep knowledge and 
tailor the message to facilitate the intended impact for targeted listeners and readers. Conveniently for assessment, we 
can also state that understanding includes the ability to communicate or convey that understanding via writing or other 
representations. Thus, the act of communicating one’s understanding of a text becomes an evidence source for evaluating 
comprehension. 


An Example Assessment 

Thus far, we have discussed the theoretical, conceptual, and empirically motivated elements of the building and sharing 
knowledge key practice. In this section, we provide an example of an assessment that is designed to model aspects of the 
building and sharing knowledge phases and how they might be useful for instruction. Recall that one of the purposes for 
creating a key practice is to motivate the development of a family of related assessments. These families may differ not 
only in the texts and topics used in the assessments, but also in which phases are emphasized in the key practice. In other 
words, the scope of any key practice is large, and as a result, no one assessment will likely cover all aspects of every phase 
in a key practice. Complete coverage would be handled across several assessments with different skill foci. With this in 
mind, we describe one building and sharing knowledge key practice assessment called “dolphin intelligence” that does 
cover a range, but not all aspects, of the building and sharing knowledge practice. 

The aim of the dolphin intelligence assessment is to help facilitate and model students’ ability to learn and convey 
what they have learned from text. At a high level, the assessment provides a realistic purpose for reading a collection of 
thematically related but diverse sources on the topic of dolphin intelligence. The sources include an informally written 
informational text, a research-based text, a video, a cartoon, and a case study. The assessment covers a wide range of 
skills: identify relevant sources and search results, extract key ideas and supporting details, use notes, provide vocabulary 
definitions and use context to infer word meanings, engage in metacognitive and self-regulatory behaviors, construct a 
graphic organizer, evaluate parts of a summary, correct erroneous parts of a summary, produce a written summary, and 
write an informed essay. 

Collectively, the above skills and the culminating writing task are very complex. Implementing them in a traditional 
style of assessment that is decontextualized and not structured is likely only to reveal that lower performing students 
cannot do many of these complex tasks. The advantage of the scenario-based assessment design, as well as the processes 
in the key practice, is that it helps to ensure that the assessment is more revealing of student partial knowledge and skill 
development. In addition, the assessment is designed to model good practice and provide information that is useful for 
instruction. 
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To achieve these aims, the assessment design is structured in a particular sequence of tasks. At the beginning of the 
assessment, the test takers are given a clear purpose for reading sources, including a context, task goals, and a culminating 
outcome writing assignment. In particular, the students are given the following instructions: 

To prepare for this year’s science fair, your class has divided into teams. Each team will research a different topic about 
dolphins. Your team has decided to focus on the topic of dolphin intelligence because dolphins are known to be very 
smart. With your team, you will gather information about dolphin intelligence and create a poster. Then, on your 
own, you will write a report that answers these two questions: In what ways are dolphins intelligent? How do we 
know? The poster and your report will be displayed for parents and other visitors at the science fair. 

In congruence with the first phase of the building and sharing knowledge key practice, set goals and activate prior knowl¬ 
edge, students are given explicit information for what is expected of them (i.e., write an essay), what particular questions 
they need to answer, and who is the audience. These goals are aimed to help set up the context and to structure further 
reading and writing. 

To supplement this phase, the test takers are then given more specific goals that outline the structure of the assessment: 

Task 1: Getting started 

Task 2: Learning about dolphin intelligence 

Task 3: Finalizing the poster 

Task 4: Writing your report 

Each of these tasks is mapped onto targeted levels in relevant learning progressions, as explained in Table 2. Since this is 
designed as a sixth-grade assessment, most of the targeted levels are in the middle of the scale, at learning progression 
Levels 2 and 3. Note that the design reflects specific constraints—we have prioritized some progressions over others and 
have not sampled any one progression across many levels. Other scenario-based assessments might be more focused, 
covering multiple levels of a single learning progression, but our goal in this assessment design was to assess critical skills 
appropriate for sixth grade in a sequence that models how those skills are relevant to the task of building and sharing 
knowledge from informational texts. 

In Task 1, test takers are asked to evaluate the relevance of both library and Web search results. These items are designed 
to focus test takers’ attention on aspects that are relevant to the broader task goals. In a formative assessment context, 
teachers could also provide a measure of student background knowledge on the topic of animal intelligence. If students 
have little prior understanding of the topic, an orienting video could be viewed to build up student background knowledge 
before they read. With this background, students with low knowledge would be better prepared to read the texts. 

Task 2 in the assessment is primarily designed to measure the understand the text phase of the key practice. To build 
up their understanding of the topic, students are presented with a relatively easy informational text that is written in an 
informal way. This text is designed to introduce the topic and build up initial understanding before presenting the more 
demanding tasks that appear later. Questions in this task require the students to select the main idea from a list of student 
notes. This task helps both to support and model the note-taking strategy as well as to support the skill of extracting key 
ideas by first asking an item that requires a selected response rather than a more difficult constructed response (which 
will come later in the assessment). Requiring easier item types early in the assessment is likely to build more student 
confidence than if harder items were required early on. 

This item is followed by another sequenced item on vocabulary. First, test takers are asked to provide a definition of key 
vocabulary terms. This task is designed to measure whether students can independently complete a constructed response 
task without any help. This task is followed up by an item that measures partial understanding. In the following item, 
students are provided with their prior constructed response definition, and then they are asked to select some words from 
the text that help provide clues to the words meaning. To support this process, a selection of words in the text is highlighted 
to reduce the difficulty. Collectively, this item supports the strategy of inferring word meanings from context. Moreover, 
during this item, the student also has the option of changing his or her original constructed response answer now that 
the task has directed attention to the supporting context. This option serves as a way to model the metacognition and 
self-regulation or clarify meanings phase of the key practice. 

Next, students are provided with summary guidelines that outline the characteristics of a good summary. This presen¬ 
tation is designed to model good practice. After the guidelines are presented, test takers are asked to select the main idea 
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Table 2 Correlation of Tasks and Skills (how this assessment measures targeted skills) 


Test section 

Strategy or skill 

What the test assesses 

Learning progression mapping 

Task 1 

Previewing a text and predicting 

Whether students can accurately judge 

Table A3, Interpretive column, Levels 2 


what it is mostly about 

whether a source will be relevant 
after reading a brief description of its 
content (such as an Internet or 
library search result) 

to 3 

Task 2.1 

Determining central ideas 

Whether students can recognize which 
of multiple alternatives is an accurate 
representation of the main idea of a 

text 

Table A6, Interpretive column. Levels 1 
to 2 


Inferring meaning from cues in 

Whether students can define what a 

Table A10, Interpretive column, Levels 


the text, fitting new knowledge 

word means in context 

2 to 3 


in with prior knowledge, 
finding out more 

Whether students can identify context 
cues to infer meanings of difficult 
words 

Table A13, Levels 2 to 3 


Identifying main ideas 

Whether students can organize main 

Table A6, Interpretive column, Level 2 


Identifying details 

ideas and details in a single graphic 

Table A6, Interpretive column, Level 3 


Synthesizing ideas and 
information from different 
parts of a text 

organizer 

Table A7, Level 3 


Identifying Main Ideas 

Whether students can link the main 
ideas expressed in a cartoon and a 
targeted text. 

Table A6, Interpretive column, Levels 1 
to 2 

Task 2.2 

Evaluating summaries 

Whether students can identify flaws in 
other students’ summaries 

Table A6, Levels 1 to 3 — links to all 

three columns 


Paraphrasing 

Whether students can identify exact 
quotes or recognize accurate 
paraphrases 

Table A9, Expressive column, Levels 2 
to 3 

Task 2.2 

Writing summaries 

Whether students can summarize an 

interview 

Table A6, Expressive column, Levels 1 
to 3 

Task 3 

Clarifying understanding, 

expecting to achieve coherence 

Whether students can organize 
information effectively using 
hierarchical graphical organizers 

Table A8, Deliberative column, Level 3 

Task 4 

Communicating knowledge 

Whether students can write an accurate 

Table A14, Expressive and Deliberative 


Defining audience, adapting 
explanations 

report that synthesizes information 
across multiple text sources. 

columns, Levels 2 to 3 


and the supporting details from a simulated set of student notes. This task is more demanding than the easier task that only 
asks for one main idea. In this way, the assessment gets progressively more difficult but still offers the notes as support. To 
help support integration, a following task requires the test takers to connect the key idea of the article with a cartoon on 
the topic. This task not only supports integration processes, but also the visualization strategy in the understand-the-text 
phase. 

The next series of tasks is designed to help students organize the important information. This occurs in the con¬ 
text of building a larger, more complicated graphic organizer. Because the information is complex, the assessment is 
designed to structure this task over the course of the assessment. Instead of building up the complex graphic all at 
once, the process is broken down into a series of small steps whereby smaller pieces are built one at a time. After each 
section is built, it is added onto the prior sections until the final product is completed near the end of the assessment. 
To support skill development, each test taker selects concepts for the graphic organizer cells from simulated student 
notes. Again, this task supports the note-taking strategy and the graphic organizer strategy, while simultaneously mod¬ 
eling the task in a more approachable way (i.e., using selected response as opposed to constructed response). To further 
support development, some of the graphic organizer cells are partially filed out, to help the students orient themselves 
to the task. 
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Later in Task 2, test takers are given a second, more detailed text that provides deeper information. This text is more 
difficult than the first text, as the author discusses empirical research on the topic of dolphin intelligence. Subsequent tasks 
require each test taker to evaluate simulated students main ideas with a set of criteria. Other tasks require the test taker to 
identify a problem in a simulated student’s main idea and detail list. A subsequent task requires the test taker to suggest 
an alternative for one of the incorrect parts of the simulated student response. This task helps support metacognitive and 
self-regulatory processing in the clarify meanings phase. It also helps identify where a student is having difficulty: with 
identifying an error or with fixing it. 

A subsequent task presents the test takers with a video in which they are asked to summarize it in a constructed 
response format. This task represents the most difficult part of summarization: producing a summary. This task not only 
helps support the consolidate phase of the key practice but, in conjunction with prior tasks, also helps identify weakness 
in component summary skills. Earlier tasks measure student ability to identify a main idea, identify details, identify a 
problem, and fix a problem. If only the constructed response summary task was given, there would not be any information 
on whether a student could do the pieces that feed into the more complex written response. Having a collection of these 
subcomponents is potentially useful for diagnosis and instruction, as it potentially can help locate the particular skill area 
in need. 

In Task 3, test takers are given a new text that provides a case study of dolphin intelligence. Subsequent tasks require 
each test taker to use student notes to build up the prior graphic organizer until it is fully completed. The final task, Task 4, 
is designed to assess the convey knowledge phase of the assessment. In this task, test takers are asked to write a report that 
answers the questions posed at the beginning. With the help of the sources they read in earlier sections, students have the 
appropriate content knowledge to form a coherent and deep answer. To further support this process, this section provides 
a range of writing tools to help scaffold the process. These tools include a set of references to cite, a writing checklist, and a 
planning tool (graphic organizers and charts). The checklist reviews the task goals (In what ways are dolphins intelligent? 
How do we know?), provides a task structure, and has a checklist for the use of engaging language and mechanics (e.g., 
spelling, grammar). 

Collectively, the dolphin intelligence assessment is illustrative of several aspects of scenario-based assessment and the 
building and sharing knowledge key practice. Clear goals and expectations are set at the beginning, information is built up 
over time, supports are given, and complex tasks are broken down. Taken together, these design features help model skilled 
performance while at the same time provide information on partial skill development. With this design, the assessment 
becomes both a model for strategic processing and a tool for identifying weakness in component skills. 


Summary and Conclusion 

The purpose of this paper is to provide an overview of the building and sharing knowledge key practice. In doing so, we 
have discussed a type of assessment design—scenario-based assessment—that is intended to target deeper understanding 
with a set of thematic source materials. This design, while bridging some gaps in assessing a richer construct of reading 
and writing, nonetheless does not necessarily yield transparent inferences about what students can and should be able 
to do. To bridge this gap, we introduced the notion of key practices, which are a set of associated reading and writing 
skills that are designed to serve particular literacy goals. By creating a broad, but meaningful set of key practices, it is our 
hope that those practices will help students (and their teachers) to focus on the critical skills needed to succeed in literacy 
activities in the 21st century. 

More specifically, this paper has provided the rationale, definition, and empirical underpinnings for one such key 
practice called building and sharing knowledge. This key practice outlines the critical skills necessary to understand and 
communicate what is learned from text. The practice is divided into four parts. First, students set goals and activate relevant 
background knowledge to facilitate subsequent reading. During reading, students deploy a variety of reading strategies 
to build a coherent mental model of the text. When misconceptions or gaps in understanding are encountered, students 
use metacognitive and self-regulatory skills to correct any problems to keep understanding on track. Deep, stable, and 
flexible understanding is facilitated by requiring students to consolidate what they read with their background knowl¬ 
edge. Finally, students are expected to convey and communicate what they have read to targeted audiences and adjust 
their communications accordingly. Collectively, the building and sharing knowledge key practice is foundational to other, 
higher order key practices and remains itself a critical 21st-century literacy skill set. 
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Notes 

1 A broad goal of the multidisciplinary, CBAL initiative is to leverage the literature in the learning sciences to produce assessments 
that are manageable, targeted, and useful for instruction in English language arts, mathematics, and science. 

2 As an exception, note that National Assessment of Educational Progress (NAEP) Reading and the SAT® Verbal are examples of 
two assessments that do include some questions that span more than one passage. The TOEFL iBT® Read, Listen and Write task 
also involves the integration of multiple sources that span across modality (visual and auditory). 

3 For more information on scenario-based assessment see O’Reilly and Sabatini (2013). 

4 Elements of the previewing strategy are also central to the commonly used “Know-Want-Learn” (K-W-L) reading strategy (see 
Cantrell, Fusaro, & Dougherty, 2000; Lewis, Wray 8c Rospigliosi, 1994; Ogle, 1986). 

5 While there have been debates about the precise differences between a skill and a strategy (Afflerbach, Pearson, 8c Paris, 2008), 
the term strategy is used here to refer to the set of techniques that are directed toward improving understanding and are 
sometimes a part of larger, more holistic, reading interventions. 

6 Metacognition and self-regulation are related but distinct concepts (Dinsmore, Alexander, 8c Loughlin, 2008). They are discussed 
together here to reflect their symbiotic nature. 

7 The KWL and previewing strategies are widely used in many different ways by educators. The purpose here is not to discuss these 
differences, but introduce the larger concepts for illustration purposes. 
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find relevant content. across a hierarchy of prototypes like the consolidate ones content. 

goals and subgoals. five-paragraph essay. comprehension of the 

relationships among the 
parts. 
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elaborative inference. 
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discipline and genre. purpose. 
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